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Abstract — A comparison study is presented between the discrete 
time Kalman filter and the Information filter, which are 
equivalent with respect to their behavior, since they produce the 
same estimations. The computational requirements of the Kalman 
and Information filters are determined and a method is proposed 
to a-priori (before the filters' implementation) decide which filter 
is the faster one. 
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I. Introduction 

Estimation plays an important role in many fields of 
science: applications to aerospace industry, chemical process, 
communication systems design, control, civil engineering, 
filtering noise from 2-dimensional images, pollution prediction 
and power systems are mentioned in [1]. The estimation 
problem arises in linear estimation and is associated with 
discrete time systems described by the following state space 
equations: 



z k= H A+ v k 



(1) 



for k > , where X k is the nxl state vector, Z k is the 

mxl measurement vector, F k is the nxn transition matrix, 

H k is the mxn output matrix, W k is the nxl state noise 

vector and V k is the mxl measurement noise vector at time 

k . Also, {w k } and {v k } are independent Gaussian zero-mean 

white and uncorrected random processes, Q k and R k are the 
nxn plant and mxm measurement noise covariance 
matrices respectively and X is a Gaussian random process 

with mean X and covariance P . 

The filtering problem is to produce the optimal estimation 
X k/k of the state vector at time k given the measurements set 

Z k ={z ,z 1 ,z 2 ,...,z k ] up till time k. 

The n x 1 estimation vector is x k/k = E[x k / Z k ] and the 
nxn estimation error covariance is 

p k/k = £ [(X -x k/k )(x k -x k/k f /Z k ] . 

The nxl prediction vector is x k+yk = E[x k+l l Z k ] and the 
nxn prediction error covariance is 

"k+l/k = El(X k+1 - x k+llk )\ X k+\ ~ X k+ltk ) ' Z k J ■ 

The discrete time Kalman filter [1] and Information filter 
[1], [6], [8] are well known algorithms that solve the filtering 



problem. Both filters have been used in various applications: 
Kalman filter applications are referred in [1], [2], [4], [10], 
while Information filter applications are mentioned in [4], [5], 
[7], [9], [11]. 

In this paper, a comparison study for the Kalman and 
Information filters is presented. The paper is organized as 
follows: The Kalman filter and the Information filter are 
presented in sections 2 and 3, respectively. The computational 
requirements of the Kalman and Information filters are 
determined in section 4. A method is proposed to decide which 
filter is the faster one in section 5. Finally, section 6 
summarizes the conclusions. 

II. KALMAN FILTER 

For time varying systems, the Time Varying Kalman 

Filter (TVKF) [1] is summarized in the following: 

K k = P kl k- l H T k [H k P klk _ 1 H T k+ R k r 1 
x klk =U- K k H k] x k l k-i + K k z k 



(2) 



Fk x k/k 



P -O 



F P F 

* k r klk L k 



■ k+llk ^<k 

for k = 0,l,... and with initial conditions X Q/ _ 1 =X and 
P = P 

The existence of the inverse matrices that appear in Kalman 
filter equations is guaranteed in the case where the 
measurements noise covariances R k are positive definite, 

denoted by R k > ; this happens in the case where no 

measurement is exact. 

For time invariant systems where the transition matrix 
F =F k , the output matrix H = H k , as well as the plant and 

measurement noise covariance matrices Q = Q k and R = R k 

are constant matrices, the Time Invariant Kalman Filter 
(TIKF) is derived. 

III. INFORMATION FILTER 

As described in [6], [8], the Information filter uses the 
Information matrix, which is the inverse S k/k of the 

covariance matrix P k/k , and the Information state vector y k/k 

which is connected to the estimation vector ^k/k through the 

Information matrix. In fact, the Information filter uses the 
definitions: 
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y^lk "klk X klk 



S = P 1 

^k/k r klk 



(3) 



y klk 



P' 1 X 

r klk-l A klk-l 



c _ p-i 



The Information filter is derived using the Kalman filter 
equations and the Matrix Inversion Lemma [1]: let the nxn 
identity matrix J , the nxn matrix P , the mxn matrix H 
and the mxm matrix R ; then the following equatily holds 
under the assumption that the inverses exist: 



[I + P^R-'HT'P = [P- 1 +H T R~ 1 H]- 1 

= P-PH T [HPH T +RT 1 HP 



(4) 



For time varying systems, the Time Varying Information 

Filter (TVIF) [1], [6], [8] is summarized in the following: 





ykik - yk/k-i + H k R k z k 






S k/k =s k/k-i +H k R k H k 






p - S" 1 

r klk ^klk 






X klk ~ ^klkVklk 






K k = Sk/kHkRk 1 


(5) 




"k+i/k = Qk + ^k^k/k^k 






c _ p-i 

^k+l/k r k+Vk 






yk+llk ~ ^k+l/k^k^k/kyk/k 






X k+Vk ~ ^k+l/k+l^fc+l/k 




for 


/c = 0,l, ... and with initial 


conditions 


-Vo/-! 


= P 0l \x = P ~% and So,., = P ,\ = P ' ■ 





The existence of the inverse matrices that appear 
Information filter equations is guaranteed in the case where the 
measurements noise covariances R k are positive definite, i.e. 

R > o ; this happens in the case where no measurement is 

exact. Also, the initial condition p o has to be nonsingular. 

For time invariant systems where the transition matrix 
F =F k , the output matrix H =H , as well as the plant and 

measurement noise covariance matrices Q=Q k and R = R k are 

constant matrices, the Time Invariant Information Filter 

(TIIF) is derived. Note that the matrices ir 1 , H T R'\ H T i? _1 H 
are calculated off-line. 

The Information filter equations are derived by the Kalman 
filter equations. Thus the Information filter equations are 
algebraically equivalent to the Kalman filter equations [1] and 
the Kalman and Information filters calculate theoretically the 
same estimates as well as the same estimation error 
covariances. This means that the two filters are theoretically 
equivalent with respect to their performance. 

IV. COMPUTATIONAL REQUIREMENTS 

The Kalman and Information filters calculate the same 
estimates. Then, it is reasonable to assume that both the 
Kalman filter and the Information filter compute the estimate 



value X k/k of the state vector X k executing the same number 

of iterations. Thus, in order to compare the algorithms with 
respect to their computational time, we have to compare their 
per step (iteration) calculation burden (CB) required for the on- 
line calculations; the calculation burden of the off-line 
calculations (initialization process for time invariant and steady 
state filters) is not taken into account. 

Scalar operations are involved in matrix manipulation 
operations, which are needed for the implementation of the 
filtering algorithms. Table I summarizes the calculation burden 
of needed matrix operations. Note that the identity matrix is 
denoted by I and a symmetric matrix by S . The details are 
given in [3]. The per step (iteration) calculation burdens of the 
Kalman and Information filters are analytically calculated in 
the Appendix and summarized in Table II. 

TABLE I 
CALCULATION BURDEN OF MATRIX OPERATIONS 



Matrix 
Operation 


Matrix 
Dimensions 


Calculation 
Burden 


A+B = C 


(nxm) + (nxm) 


nm 


A+B = S 


(n x n) + (n x n) 


i" 2 +i" 


I + A = B 


(nxn) + (nxn) 


n 


AB = C 


(nxm)(m x£) 


2nm£-n£ 


A-B = S 


(nxm) (mxn) 


n 2 m + nm-jn 2 -\n 


A^ = B 


(nxn) 


i(16n 3 -3n 2 -n) 



TABLE II 
PER STEP CALCULATION BURDEN OF FILTERS 



System 


Filter 


Calculation 
Burden 


Time 
Varying 


Kalman 
Filter 


CB„ KF =4n 3 +fn 2 -fn 

+ 4n 2 m + nm + 3nm 2 
+ i(16m 3 -3m 2 -m) 


Information 
Filter 


CB mF =}(25n 3 + 21n 2 -13n) 
+ 3n 2 m + nm + 2nm 2 
+ {(16m 3 -3m 2 -m) 


Time 
Invariant 


Kalman 
Filter 


CB TIKF =4n 3 +fn 2 -fn 

+ 4n 2 m + nm + 3nm 2 
+ {(16m 3 -3m 2 -m) 


Information 
Filter 


CB m , = -|(50n 3 + 45n 2 - 23n) 
+ 2n 2 m + nm 



V. SELECTION OF THE FASTER FILTER 

In the following, a method is proposed to select the faster 
filter. From Table II, it is clear that the algorithms' calculation 
burdens depend on the state vector dimension n and the 
measurement vector dimension m . Thus, the selection of the 
faster implementation depends on the relationship between n 
and m . 

For time varying systems, the difference between the 
calculation burden required for the time invariant Kalman filter 
implementation and the calculation burden required for the 
time invariant Information filter implementation is: 



= in(6m 2 + 6nm-26n 2 -21/7+17) 



(6) 
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Consider the quadratic function of XXI : 

qjyim) = 6m 2 + 6nm-26n 2 -21/7 + 17 
Then the equation q TV (jxi) = has a positive real 
6n + V660n 2 +504n-408 



root Pw ( n) 



since the 



12 



discriminant A = 660n 2 + 504n-408 is a positive number and 
the product of its real roots is equal to i(-26n 2 -21n+17) < 0, 

for every n > 1 . 

Hence, if m > p^ (n) , then it is implied that 

6m 2 + 6nm-26n 2 -21n+17>0 . Thus, for time varying 
systems, when \<m< p^ (n) , the faster filter is the Kalman 

filter while when m>/7 7V (n) , the faster filter is the 

Information filter. 

For time varying systems, the areas where the time 
invariant Kalman or Information filter implementation is faster, 
for various values of the model order ( n=l,...,100 and 
m =1,...,100) are shown in Fig. 1. 



Time Varying Faster Filter 



Q = |(3 fll -a 2 2 ) 

= ^(84n 2 +36n-19) 

R = ^(9a 1 a 2 -27a -2a 2 3 ) 

= ^(3688n 3 + 3084n 2 - 1858n + 9) 
and the discriminant 

D = Q 3 + R 2 

_ 1663 „6 , U121 5 _ 2049 „4 22275 „3 
2048 " " r 8192 " 8192 " 32768 " 

I 41113 „2 125 „ 73 



196608 65536 7077888 

Since Q > it is obvious that D > ; thus there exist two 
complex conjugates roots p x (n) , p 2 {j l ) anc ' one reai root 
p r/ (n),[12,p.364]. 

Moreover, the real root p T1 (n) is a positive number, since 



A( n )A( n ) = A(")A(") =1 A(") I 



and 




A(")A(")A/(") = 



26n 3 + 24n 2 -14n 
16 



>0, 



40 50 60 

state dimension n 



Fig. 1 The faster time varying filter 

From Fig. 1, it is easy to conclude the following Rule of 
Thumb for time varying systems: the time varying Information 
filter is faster than the time varying Kalman filter, when the 
following relation holds: 



for every XI >1. 

Hence, if XXI > p TI (n) , it is implied that q n (m) > . 

Thus, for time invariant systems, when 1 < Vft < p TI (n) , the 

faster filter is the Kalman filter, while when 171 > p TI (n) , the 
faster filter is the Information filter. 

For time invariant systems, the areas where the time 
invariant Kalman or Information filter implementation is faster, 
for various values of the model order ( n=l,...,100 and 

m =1,...,100) are shown in Fig. 2. 

From Fig. 2, it is easy to conclude the following Rule of 
Thumb for time invariant systems: the time varying 
Information filter is faster than the time varying Kalman filter, 
when the following relation holds: 



m>0.75n 



Time Invariant Faster Filter 



(9) 



m >1.65n 



(7) 



For time invariant systems, the difference between the 
calculation burden required for the time invariant Kalman filter 
implementation and the calculation burden required for the 
time invariant Information filter implementation is: 



,, 3 18n-3 

(m + m 



Yin 1 



16 16 

Consider the cubic function of XXI : 



-1 26n J + 24rT 
-m 



-14rr 



(8) 



i 

2 40 
c 

01 

E 

03 

S 30 



16 



q TI (m) = m +- 



18n-3 



12n 2 



16 



16 



-1 26n 3 
-m 



-24n -14n 



16 



Information filter 



Then by [12, p. 362-365] the solution of the cubic equation 
q (m) = is related to the intermediate variables 



10 20 30 40 50 60 70 80 

state dimension n 

Fig. 2 The faster time invariant filter 



IJIE Vol.2, No.l, Mar. 2012, PP.1-5 www.ij-ie.org © 2011-2012 World Academic Publishing 



International Journal of Information Engineering 



(DIE) 



This result is confirmed through the following examples 
taken from [3], 

Example 1. An AR type model is considered in this 
example, where n = 3 and m = 1 . The speedup from 
Information filter to Kalman filter is equal to: 



speedup T 



CH T 



C£L 



: 1.6324 



Thus, the time invariant Kalman filter is 1.6 times faster 
than the time invariant Information filter. 

Example 2. A typical multisensor problem (seismic signal 
processing) is considered in this example, where n = 4 and 
m = 1000 . The speedup from Kalman filter to Information 
filter is equal to: 



speedup T 



Cd t 



CB T 



■■ 7.309991828 10 4 



Thus, the time invariant Information filter is 73100 times 
faster than the time invariant Kalman filter. 

VI. Conclusions 

The Kalman filter and the Information filter are equivalent 
with respect to their behavior, since they produce the same 
estimations and estimation error covariances. A comparison 
study between the discrete time Kalman and the Information 
filter was presented. The computational requirements of the 
Kalman and Information filters were determined and it was 
pointed out that they depend on the state vector dimension n 
and the measurement vector dimension m . A method is 
proposed to a-priori (before the filters' implementation) decide 
which filter is the faster one: the Information filter is faster 
than the Kalman filter when state vector dimension n is grater 
enough than and the measurement vector dimension m ; in 
fact the Information filter is faster than the Kalman filter when 
m > 1.65n for time varying systems and when m > 0.75n for 
time invariant systems. 
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APPENDIX 



Time Varying Kalman Filter (TVKF) 


Matrix 
Operation 


Matrix 
Dimensions 


Calculation 
Burden 


H*P»/*-i 


(mxn)-(nx.n) 


2n 2 m-nm 


HAn-rf 


(mxn)(nxm) 


nm 2 + nm 
-\m 2 -\m 


O k =H t P ilk _ 1 H T i 


(mxm) + (mx m) 


jm 2 +jm 


or 1 


(mxm) 


{(16m 3 -3m 2 -m) 


K k = P^-rfo; 1 


(nxm) (mxm) 


2nm 2 -nm 


K k H k 


(n x m) • (m x n) 


2n 2 m-n 2 


I-K k H k 


(nxn) + (nxn) 


n 


[I-M,]^,-, 


(nxn)-(nxl) 


2n 2 -n 


K k z k 


(nxm)-(mx 1) 


2nm -n 


x klk = K k z k + 


(n x 1) + (n x 1) 


n 


P t/k = 


(nxn)-(nx n) 


n 3 +\n 2 -\n 


X k +llk = F k X k lk 


(nxn)-(nxl) 


2n 2 -n 


F k P klk 


(nxn)-(nx n) 


2n 3 ~n 2 


p p p T 

1 k^k/k 1 k 


(nxn)-(nx n) 


n 3 +±n 2 -±n 


+ F k P k/ X 


(nxn) + (nxn) 


-1-n 2 + {n 


CB^p = An 3 + \ n 2 - \ n + An 2 m + nm + 3nm 2 + {(16m 3 - 3m 2 - m) 




Time Invariant Kalman Filter (TIKF) 


Matrix 
Operation 


Matrix 
Dimensions 


Calculation 
Burden 


»U-i 


(mx n)(nxn) 


2n 2 m-nm 


HP klk ^H T 


(mx n)-(nxm) 


nm 2 +nm 
--|m 2 -yrti 


O k =HP klk _ 1 H T 
+ R 


(m x m) + (m x m) 


\m 2 +\m 


Of 1 


(mx m) 


}(16m 3 -3m 2 -m) 


K k = Pkik-fl'o; 1 


(nxm)(mxm) 


2nm 2 -nm 


K k H 


(nxm)-(mxn) 


2n 2 m-n 2 


I-K k H 


(nxn) + (nxn) 


n 


[f-KA«, 


(nxn)-(nxl) 


2n 2 -n 


K k z k 


(nxm)(mx 1) 


2nm-n 


x k,k= K k z k + 

[f-«A,.-i 


(nxl) + (nxl) 


n 


p klk = 

[I-K„H]P t;M 


(nxn)(nx n) 


n 3 +\n 2 -\n 


X k+llk = F X k /k 


(nxn)-(nx 1) 


2n 2 -n 


FP 


(nxn)(nx n) 


2n 3 ~n 2 
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FP k/k F T 


(nxn)(nx n) 


n 3 +fn 2 -{n 


+ FP klk F T 


(nxn) + (nxn) 


ln 2 + }n 


CB nKF =4n 3 +fn 2 - 


•f n + 4n 2 m + nm + 3nm 2 + {(16m 3 -3m 2 -m) 



Time Varying Information Filter (TVIF) 


Matrix 
Operation 


Matrix 
Dimensions 


Calculation 
Burden 


r; 1 


(mxm) 


{(16m 3 -3m 2 -m) 


*W 


(nxm)(mx m) 


2nm 2 -nm 


*W** 


(nxm)-(mxl) 


2nm-n 


}\/k = J^/k-l 


(n x 1) + (n x 1) 


n 


*W»» 


(nxm)(mxn) 


n 2 m + nm 
-in 2 -{n 


^k/k = \/k-l 

+ n T k R; 1 H k 


(nxn) + (nxn) 


K+!" 


P - s _1 

r klk ~ J k/k 


(nxn) 


{(16n 3 -3n 2 -n) 


X k/k — ^k/k^k/k 


(nxn)-(nx 1) 


2n 2 -n 


K k = S klk H k R k 


(nxn)(nxm) 


2n 2 m-nm 


F S _1 

r k°klk 


(nxn)(nx n) 


2n 3 -n 2 


F S _1 F T 

r k^k/k r k 


(nxn)(nx n) 


n 3 +±n 2 -±n 


"k+l/k = Vk 


(nxn) + (nxn) 


\n 2 + {n 


S — P 1 


(nxn) 


{(16n 3 -3n 2 -n) 


F^klkYklk 


(nxn)-(nx 1) 


2n 2 -n 


^k+l/k = 

^k+l/k^k^k/kyk/k 


(nxn)-(nx 1) 


2n 2 -n 


X k+l/k — 

"k+1/k^k+l/k 


(nxn)-(nx 1) 


2n 2 -n 


CB Tvll , = }(25n 3 + 21n 2 -13n) + 3n 2 m + nm + 2nm 2 + {(16m 3 - 3m 2 - m) 



Time Invariant Information Filter (TIIF) 


Matrix 
Operation 


Matrix 
Dimensions 


Calculation 
Burden 


H T R~\ 


(nxm)-(m xl) 


2nm-n 


yklk = -Vk/k-l 

+ H T R' l z k 


(nxl) + (nxl) 


n 


^klk J k/k-l 

+ H T R~ l H 


(nxn) + (nxn) 


\n 2 + {n 


P - T 1 

r klk ^klk 


(nxn) 


{(16n 3 -3n 2 -n) 


X klk = ^k/k^k/k 


(nxn)-(nx 1) 


2n 2 -n 


K k = S-^H'R- 1 


(nxn)(nxm) 


2n 2 m-nm 


Fs;] k 


(nxn)-(nx n) 


2n 3 -n 2 


FSukF 1 


(nxn)-(nx n) 


n 3 +in 2 -{n 


Pk +llk =Q 

+ FS- k \F T 


(nxn) + (nxn) 


K+i" 


c _ p-i 


(nxn) 


{(16n 3 -3n 2 -n) 


Fs;) k y klk 


(nxn)-(nx 1) 


2n 2 -n 


yk+llk = 

Sk+llk F^klkYklk 


(nxn)-(nx 1) 


2n 2 -n 


X k+llk = 

"k+1/k^k+l/k 


(nxn)-(nx 1) 


2n 2 -n 


CB TIIF = {(50n 3 + 45n 2 - 23n) + 


2n 2 m + nm 
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